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The MAILING DATE of this communication appears on the cover sheet with the correspondence address - 
Period for Reply 

A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE MONTH(S) FROM 

THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1.136(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 

- If the period for reply specified above is less than thirty (30) days, a reply within the statutory minimum of thirty (30) days will be considered timely. 

- If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 133). 

- Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment. See 37 CFR 1.704(b). 

Status 

1 )S Responsive to communication(s) filed on 12 March 2001 . 
2a)D This action is FINAL. 2b)E3 This action is non-final. 

3) D Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quayle, 1935 CD. 1 1 , 453 O.G. 213. 
Disposition of Claims 

4) ^ Claim(s) 1-20 is/are pending in the application. 

4a) Of the above claim(s) is/are withdrawn from consideration. 

5) D Claim(s) is/are allowed. 

6) ^ Claim(s) 1-20 is/are rejected. 

7) D Claim(s) is/are objected to. 

8) D Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

9) D The specification is objected to by the Examiner. 

10) D The drawing(s) filed on is/are: a)D accepted or b)D objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1 .85(a). 

1 1) D The proposed drawing correction filed on is: a)D approved b)D disapproved by the Examiner. 

If approved, corrected drawings are required in reply to this Office action. 

12) D The oath or declaration is objected to by the Examiner. 
Priority under 35 U.S.C. §§119 and 120 

13) D Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 1 19(a)-(d) or (f). 

a)QAII b)Q Some*c)D None of: 

1 .□ Certified copies of the priority documents have been received. 

2.Q Certified copies of the priority documents have been received in Application No. . 

3-D Copies of the certified copies of the priority documents have been received in this National Stage 
application from the International Bureau (PCT Rule 17.2(a)). 
* See the attached detailed Office action for a list of the certified copies not received. 

14) Q Acknowledgment is made of a claim for domestic priority under 35 U.S.C. § 1 19(e) (to a provisional application). 

a) □ The translation of the foreign language provisional application has been received. 

15) D Acknowledgment is made of a claim for domestic priority under 35 U.S.C. §§ 120 and/or 121. 
Attachment(s) 

1 ) £3 Notice of References Cited (PTO-892) 4) □ Interview Summary (PTO-41 3) Paper No(s). . 

2) □ Notice of Draftsperson's Patent Drawing Review (PTO-948) 5) □ Notice of Informal Patent Application (PTO-152) 

3) □ Information Disclosure Statement(s) (PTO-1449) Paper No(s) . 6) □ Other: 
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DETAILED ACTION 



Claim Rejections - 35 USC § 102 



1 . The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that 
form the basis for the rejections under this section made in this Office action: 
A person shall be entitled to a patent unless - 

(b) the invention was patented or described in a printed publication in this or a foreign country or in public 
use or on sale in this country, more than one year prior to the date of application for patent in the United 



2. Claims 1-9, 11 and 13-17 are rejected under 35 U.S.C. 102(b) as being 
anticipated by De Armas et al. (U.S. Patent No.5,873,064). 

Referring to claim 1 , De Armas et al. discloses a method of navigating a menu 
structure with an electronic product, comprising the steps of: 

identifying a first location (sub-context object or window object) within the menu 
(set of window objects or sub-context tree) (col.2, ln.50 - col.3, In. 14 and col.4, ln.35- 



obtaining a first utterance of speech (col. 6, In. 19-67); 

associating the first utterance with the first location and generating therefrom a 
stored first location (sub-context object vocabulary set) (col. 6, In. 50-67); 

obtaining a second utterance of speech (col .6, In. 19-67); 

matching the second utterance with the first utterance to identify the stored first 
location (sub-context object vocabulary set or vocabulary sub-sets) within the menu (set 
of window objects or sub-context tree) (col. 5, ln.44-59); and 

navigating to the first location (col.5, ln.44-59). 



States. 



43); 
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Referring to claim 2, De Armas et al. discloses a method of navigating a menu 
structure with an electronic product, comprising the steps of: 

identifying a user-selected navigation path through the menu structure to a first 
location within the menu (col.2, ln.50 - col.3, In. 14 and col.4, ln.35-43); 

obtaining a first utterance of speech (col.6, In. 19-67); 

associating the first utterance with the navigation path (col. 5, ln.44-59 and col.7, 
ln.36-67); 

obtaining a second utterance of speech (col.6, In. 19-67); 

matching the second utterance with the first utterance to retrieve the navigation 
path (sub-context object path) associated with the first utterance (col. 5, ln.44-59 and 
col.7, ln.36-67); and 

using the retrieved navigation path to navigate to the first location within the 
menu (col.5, ln.44-59; col.7, ln.36-67 and col.8, ln.25-46). 

Referring to claim 3, De Armas et al. discloses the method of navigating the 
menu structure with the electronic product, further comprising storing the navigation 
path as a sequence of navigation steps leading to the first location (sub-context object 
level) (col.7, ln.36-67); 

Referring to claim 4, De Armas et al. discloses the method of navigating the 
menu structure with the electronic product, further comprising storing the navigation 
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path as a semantic sequence of navigation steps leading to the first location (context 
data file) (col.4, ln.44-57; col.7, ln.36-67 and col.8, ln.25-46); 

Referring to claim 5, De Armas et al. discloses the method of navigating the 
menu structure with the electronic product, wherein the menu structure includes 
associated text and the method further comprising storing the navigation path as a 
semantic sequence of text associated with the navigation steps leading to the first 
location (ink field) (col .9, ln.49-61); 

Referring to claim 6, De Armas et al. discloses the method of navigating the 
menu structure with the electronic product, further comprising constructing a speech 
model associated with the first utterance (vocabulary set) and associating the speech 
model with the navigation path (context data file) (col.6, ln.6-18 and 43-67 and col.8, 
ln.25-35). 

Referring to claim 7, De Armas et al. discloses the method of navigating the 
menu structure with the electronic product, further comprising using a speech 
recognizer (voice recognition) to compare the first and second utterances in performing 
a matching step (col.3, ln.31-36; col.4, ln.35-43 and col.6, ln.43-49). 



Referring to claim 8, De Armas et al. discloses the method of navigating the 
menu structure with the electronic product, further comprising constructing a speech 
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model associated with the first utterance and using the speech model to populate a 
lexicon of speech (appropriate set of spoken commands)(col.6, In. 6-49); and 

using a speech recognizer to compare the first and second utterances in 
performing a matching step (col.4, ln.35-49 and col.8, ln.25-46). 

Referring to claim 9, De Armas et al. discloses the method of navigating the 
menu structure with the electronic product, wherein the step of identifying the user- 
selected navigation path comprises displaying the first location on a visible display 
associated with the electronic product and prompting the user to provide the first 
utterance (Fig.1 A and col.5, ln.2-15). 

Referring to claim 1 1 , De Armas et al. discloses the method of navigating the 
menu structure with the electronic product, further comprising a providing user feedback 
of the association between the first utterance and the navigation path by the first 
location on a visible display associated with the electronic product and producing a 
textual representation of the first utterance (Fig.lA, elements Child 1, OK and CANCEL; 
col.5, ln.2-15 and col .9, ln.49-61). 

Referring to claim 13, De Armas et al. further discloses the textual representation 
(decoded phrase) is provided using a speech recognizer (col.9, In. 19-61). 
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Referring to claim 14, De Armas et al. further discloses the textual representation 
(decoded phrase)is provided by storing a text data associated with the first utterance 
and displaying the text data (window text string) at user request (Fig.2; col.6, In. 19-28; 
col.8, ln.25-29 and col.9, ln.19-61). 

Referring to claim 15, De Armas et al. discloses a voice binding system to aid in 
user operation of electronic devices, comprising: 

a menu navigator that provides a traversable menu structure offering a plurality 
of predefined menu locations (Fig.lA; col.4, ln.25-43 and col.5, ln.36-39); 

a speech recognizer having an associated lexicon data store (vocabulary set) 
(col.8, ln.25-33 and col.9, In. 14-47); 

a processor for adding user-defined speech to the lexicon (the action of edit box) 
(col.7, In. 23-27); and 

a voice binding system couple to the menu navigator for associating the user- 
defined speech with predetermined menu locations within the menu structure, operable 
to traverse to a predetermined menu location in response to a spoken utterance 
corresponding to the user-defined speech ( col.7, In. 1-35). 

Referring to claim 16, De Armas et al. further discloses the menu navigator 
includes at least one navigation button operable to traverse the menu structure (Fig.lA, 
element 34). 
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Referring to claim 17, De Armas et al. further discloses the voice binding system 
stores predefined menu locations as traversal path sequences (col.8, ln.25-32 and 
col. 10, ln.21-32). 

Referring to claim 18, De Armas et al. further discloses the voice binding system 
stores predefined menu locations as semantic sequences (col.9, In. 30-61). 

Claim Rejections - 35 USC § 103 

3. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 

obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

4. Claim 10, 12 and 19-20 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over De Armas et al. in view of Croft (U.S. Patent No.6,493,670 B1). 

Referring to claims 10 and 12, De Armas discloses the method of navigating the 
menu structure with the electronic product, further comprising a providing user feedback 
of the association between the first utterance and the navigation path by the first 
location on a visible display associated with the electronic product (Fig.1 A and col.5, 
ln.2-15). 

De Armas et al. does not specifically disclose the method of navigating the menu 
structure with the electronic product, wherein it produced an audible representation of 
the first utterance; 
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wherein the audible representation is provided by storing the first utterance as an 
audio data and replaying the audio data at user request. 

Croft teaches when the user speaks into the electronic product will produce the 
audible output comparable to the sentence that was spoken by storing the first 
utterance as the audio data and replaying the audio data (speech waveform memory) 
(Fig.5, step 510 and col .5, 14-28). 

Therefore, it would have been obvious to one having ordinary skill in the art at 
the time the invention was made to modify the method of navigating the menu structure 
of the electronic product of De Armas et al. with the capability of producing the audible 
feedback output, as taught by Croft, in order to confirm to the user at user request the 
correctness of the speech recognition as taught by Croft (col.5, ln.16-18 and 27). 

Referring to claims 19 and 20, De Armas et al. discloses the voice binding 
system comprising a user feedback system operable to textual reproduce the user- 
defined speech associated with predefined menu locations (col .9, ln.49-61). 

De Armas et al. does not specifically disclose the voice binding system 
comprising a user feedback system operable to audibly reproduce the user-defined 
speech (stored as recorded speech waveforms) associated with predefined menu 
locations. 

Craft teaches when the speech recognition receives the user's spoken input, the 
system will produce the audible output if the spoken utterance from the user does match 



* 
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the defined vocabulary of the speech recognition; and playback recorded speech 
waveforms (col. 5, ln.20-24). 

Therefore, it would have been obvious to one having ordinary skill in the art at 
the time the invention was made to modify the voice binding system of De Armas et al. 
with the user feedback system, as taught by Croft, in order to confirm to the user the 
correctness of the speech recognition as taught by Croft (col. 5, ln.16-18 and 27). 



5. The prior art made of record and not relied upon is considered pertinent to 
applicant's disclosure. Scott et al. (U.S. Patent No. 6,101,473) teaches using voice 
macros for linking a remote speech recognition device operating over the telephone 
network to any web browser operating over the internet. 

6. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to the examiner Vincent V. Tran whose E-mail address: 

Vincent.tran@USPTO.GOV . 
Phone number: (703) 305-1817 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Ms. Doris To, can be reached on (703) 305-4827. Any inquiry of a general 
natural or relating to the status of this application or IF PAPER IS MISSING FROM 
THIS OFFICAL PACKAGE, PLEASE CALL Technology Center 2600 Customer 
Service at (703) 306-0377 FOR THE SUBSTITUTIONS OR COPIES. 



Conclusion 
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7. Any response to this action should be mailed to: 

Commissioner of Patents and Trademarks 

P.O. Box 1450 

Alexandria, VA 22313-1450 
Or faxed to: 

(703) 872-9314 

Hand-delivered responses should be brought to Crystal Park II, 2121 Crystal Dr, 
Arlington VA, Sixth Floor (Receptionist, Tel. No. 703-305-4700). 




Date: August 22, 2003 



